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Abstract 

The  optimal  control  of  arrivals  problem  is  one  which  has  many  applications  in  both 
defense  and  industry.  Simply  stated,  the  problem  addresses  how  to  schedule  a  finite  number 
of  customers  in  a  finite  number  of  equal-length  time  slots,  where  each  customer’s  service 
time  comes  from  a  specified  probability  distribution.  There  are  two  cost  components, 
one  based  on  total  expected  customer  waiting  time  and  the  other  based  on  the  expected 
amount  of  time  the  server  stays  open  beyond  its  scheduled  completion  time.  Currently, 
solutions  have  been  developed  to  the  optimal  control  of  arrivals  problem  but  they  are 
computationally  slow  and  only  work  for  exponential  distributions.  This  thesis  presents 
an  algorithm  for  the  optimal  control  of  arrivals  problem  which  is  both  computationally 
efficient  and  works  for  r-Erlang  distributions. 


vi 


An  Efficient  Approach  to  Solving  the  Optimal  Control  of  Arrivals  Problem 


I.  Introduction 

This  thesis  presents  a  solution  to  the  optimal  control  of  arrivals  problem,  which  en¬ 
compasses  the  areas  of  planning,  scheduling,  and  control  of  queues.  The  problem  addresses 
how  we  schedule  a  finite  number  (N)  of  appointments  in  a  finite  time  horizon  which  is  di¬ 
vided  into  a  finite  number  (*)  of  equal  length  time  units.  The  objective  is  to  determine 
the  schedule  with  the  minimum  expected  cost,  where  cost  is  measured  in  two  components: 
waiting  time  cost  and  overtime  cost.  Waiting  time  cost  is  the  amount  of  expected  customer 
waiting  time  multiplied  by  the  waiting  time  cost  per  unit.  Overtime  cost  is  the  expected 
amount  of  time  that  the  server  works  beyond  the  end  of  the  time  horizon  multiplied  by  the 
overtime  cost  per  unit.  We  assume  that  all  customers  arrive  exactly  on  time  as  scheduled, 
and  the  server  works  on  a  first-in,  first-out  basis.  We  also  assume  that  customer  service 
time  follows  an  r-Erlang  distribution.  In  all  cases,  we  assume  the  service  time  parameter, 
/z,  is  defined  as  the  service  rate  per  time  unit  A,  where  A  is  the  length  of  each  of  the  k 
time  intervals.  Wang  (1)  showed  that  the  actual  waiting  cost  and  actual  overtime  cost 
need  not  be  considered,  for  only  their  ratio  is  important.  That  ratio  is  what  we  will  refer 
to  as  C,,  or  the  cost  factor.  Therefore  in  all  calculations,  we  assume  waiting  time  cost 
is  standardized  to  1,  while  overtime  cost  equals  expected  overtime  multiplied  by  the  cost 
factor. 

The  problem  has  many  real-world  applications.  One  such  case  is  in  the  area  of 
shipping.  Consider  a  shipping  company  which  has  leased  several  hours  of  dock  access  to 
load/unload  some  of  its  ships.  It  costs  money  to  have  a  ship  waiting  in  the  harbor  before  it 
can  dock.  Also,  there  will  usually  be  a  high  penalty  for  exceeding  the  lease  period,  because 
the  company  that  owns  the  dock  wants  to  ensure  the  next  lessee  is  able  to  start  on  time. 
Therefore,  assuming  the  shipping  company  has  paid  a  fixed  fee  for  use  of  the  dock,  the 
only  additional  costs  will  be  the  cost  for  ships  waiting  in  the  harbor,  and  the  cost  for  usage 
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time  beyond  the  end  of  the  lease  period.  A  similar  problem  can  arise  in  the  context  of 
airfield  operations  when  cargo  handling  resources  are  limited. 


Much  research  has  been  done  on  the  optimal  control  of  arrivals  problem,  but  the 
solutions  developed  are  computationally  difficult.  Furthermore,  the  solutions  have  been 
approached  primarily  from  a  numerical  standpoint.  We  will  develop  an  iterative  procedure 
for  determining  the  optimal  schedule  which  will  require  the  evaluation  of  only  a  small 
subset  of  all  feasible  schedules.  The  algorithm  is  efficient  and  provides  instant  sensitivity 
analysis  on  the  optimal  solution. 

The  algorithm  works  for  r-Erlang  service  distributions,  which  are  defined  by  the 
probability  density  function: 

f(t)  =  Ae~A‘  *  (Af)r-1/(r  -  l)!,t  >  0 

Being  able  to  solve  problems  using  r-Erlang  distributions  allows  one  to  match  the  first  two 
moments  from  data,  hence  the  algorithm  is  both  a  valuable  and  practical  tool  to  use  for 
real-world  applications. 
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II.  Literature  Review 


The  optimal  control  of  arrivals  problem  has  received  much  attention  since  the  work 
of  Naor  (2)  was  published  in  1969.  In  his  article,  he  addressed  the  idea  of  limiting  queue 
length  based  on  both  individual  benefit  (the  benefit  of  the  arriving  customer)  and  social 
benefit  (the  benefit  of  the  entire  population).  He  presented  solutions  to  both  problems 
for  the  M/M/l  queue.  Knudsen  (3)  extended  Naor’s  results  to  the  M/Mflt  queue,  and 
Yechiali  extended  the  results  to  first  the  G/M/l  queue  (4)  and  later  the  G/M/k  queue 
(5).  Rue  and  Rosenshine  developed  optimal  control  policies  for  both  the  M/M/l  (6)  and 
M/Ek/l  (7)  queues  serving  multiple  classes  of  customers,  where  each  class  has  its  own 
cost-reward  structure. 

Pegden  and  Rosenshine  originally  posed  the  optimal  control  of  arrivals  problem. 
The  original  problem  considered  the  planning  of  N  arrivals  over  an  infinite  continuous 
time  horizon,  where  cost  consisted  of  two  components:  customer  waiting  time  and  server 
completion  time.  The  service  time  was  assumed  to  be  exponential.  An  analytic  closed 
form  solution  was  presented  for  the  specific  case  of  2  arrivals.  In  this  case,  the  objective 
function  was  shown  to  be  convex.  However,  no  closed-form  solution  could  be  found  for 
the  case  where  N  >  2,  and  moreover,  the  objective  function  for  the  general  case  has  not 
yet  been  proven  to  be  convex.  Numerical  methods  were  employed  to  determine  optimal 
arrival  times  for  the  case  of  N  >  2,  but  these  optima  were  only  guaranteed  to  be  local 
optima  due  to  the  uncertainty  of  the  convexity  of  the  objective  function.  Healy,  Pegden, 
and  Rosenshine  (8)  extended  the  results  of  the  single,  exponential  service  time  system  to 
two  parallel  servers  with  exponential  service  time  servers. 

Because  a  closed-form  solution  to  the  original  problem  seemed  intractable,  the  prob¬ 
lem  was  redefined  with  a  finite,  discrete  time-unit  time  horizon,  divided  up  into  k  equal 
length  time  slots.  Instead  of  scheduling  an  appointment  at  any  point  in  the  time  window, 
it  would  now  have  to  be  scheduled  at  the  beginning  of  one  of  the  k  time  slots.  Server  cost 
was  measured  as  overtime,  which  is  the  expected  amount  of  time  that  the  server  works 
beyond  the  end  of  the  finite  time  window  times  the  cost  per  unit  of  overtime.  As  before,  it 
was  assumed  that  all  customers  arrive  exactly  at  the  time  of  their  scheduled  appointment. 
It  is  important  to  note  that  this  revised  version  of  the  problem  is  actually  more  reflective 
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of  the  real  world  than  the  original,  due  to  the  use  of  the  finite  time  window  and  finite 
number  of  possible  scheduled  appointment  times. 

Two  versions  of  the  problem  were  posed.  First,  a  myopic,  or  short-range  version 
where  the  schedule  is  evaluated  at  the  beginning  of  each  of  the  k  time  slots.  This  is  a 
dynamic  approach,  where  suboptimizations  are  performed  k  times.  The  other  problem  is 
the  long-term  approach.  In  this  case,  the  entire  schedule  is  set  up  before  the  first  arrival, 
and  cannot  be  revised  at  any  later  point  in  time.  This  version  better  reflects  real-world 
scheduling,  since  one  normally  schedules  a  block  of  appointments  at  one  time  (e.g.  one 
day’s  worth)  and  seeks  to  optimize  the  expected  cost  for  that  period  of  time. 

Liao  (9)  presented  solutions  to  both  the  short-range  and  long-range  versions  of  the 
problem  with  exponentially  distributed  service  time.  The  short  range  problem  was  solved 
using  dynamic  programming,  and  then  the  long  range  problem  was  solved  using  Branch 
and  Bound  with  the  short  range  optimal  solution  taken  as  the  initial  lower  bound.  In  the 
same  work,  Liao  extended  the  results  to  the  following  models: 

•  One  server  with  Erlang  distributed  service  time. 

•  Multiple  parallel  servers  with  exponentially  distributed  service  time. 

•  Two  servers  in  sequence,  each  with  exponentially  distributed  service  time. 

•  One  server  with  exponentially  distributed  service  time  where  the  server  shuts  down 
after  the  last  appointment  has  completed  service. 

•  Several  classes  of  customers  in  the  system,  each  class  having  different  waiting  time 
distributions  and  waiting  cost  structures. 

Wang  (1)  has  recently  solved  both  the  short  range  and  long-range  versions  of  the 
original  continuous  problem  using  phase-time  distributions.  The  number  of  appointments 
(N)  was  given,  but  an  infinite  continuous  time  horizon  was  used.  Cost  was  measured  in 
both  waiting  time  and  server  completion  time.  Service  time  for  his  solution  was  assumed 
to  be  exponential. 
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III.  Theoretical  Results 

3. 1  Overview 

Upon  reviewing  the  previous  research  on  the  optimal  control  of  arrivals  problem,  we 
see  that  in  general  a  closed  form  solution  is  intractable.  Past  methodology  has  employed 
numeric  methods  to  determine  optimal  schedules,  and  certain  unproven  yet  intuitive  as¬ 
sumptions  have  been  made  in  the  algorithms.  We  shall  take  a  more  direct  approach  to  the 
solution  of  the  problem.  Before  we  begin  our  description  of  our  model,  we  will  introduce 
the  notation  and  definitions  found  throughout  this  work. 

3.1.1  Assumptions. 

Assumption  1  Each  of  the  k  time  intervals  are  of  equal  length.  When  service  time  is 
exponential,  the  service  rate  p  is  expressed  in  customer  service  completion  per  time  interval. 

Assumption  2  The  service  rate  for  each  customer  is  p.  When  the  service  distribution  is 
r- Erlang,  the  service  rate  for  each  of  the  r  stages  of  customer  service  is  r p. 

3.1.2  Notation. 

k  =  the  number  of  time  intervals 

N  =  the  number  of  appointments  to  be  scheduled 

p  =  the  service  rate 

A  =  the  length  of  each  time  slot 

0  =  the  length  of  the  finite  time  horizon 

5,  S,  =  schedules 

T,  T,  —  subschedules 

ti  =  the  ith  time  slot  of  a  schedule 

a,  =  the  jth  customer  of  a  schedule 

bi  =  the  ith  component  of  5  =  the  number  of  appointments  scheduled  at  U 
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a j  =  the  scheduled  time  of  the  jtk  customer 

C„  =  cost  per  unit  of  waiting  time 

C0  =  cost  per  unit  of  overtime 

C,  =  the  cost  factor  =  (7„/Cw 

W[5]  =  the  expected  total  waiting  time  of  5 

W[T]  =  the  expected  total  waiting  time  of  T 

0[S]  =  the  expected  overtime  cost  of  5 

0[T]  =  the  expected  overtime  cost  of  T 

t[5]  =  the  total  expected  cost  of  S 

W[cij]  =  expected  waiting  time  of  the  itk  appointment 

O’  =  expected  waiting  of  all  appointments  succeeding  a  particular  appointment  plus  0[5] 
m-cluster  =  m  appointments  scheduled  in  the  same  time  unit,  b,  =  m 

3.1.3  Definitions. 

Definition  1  A  schedule  5  is  a  candidate  if  it  has  not  been  eliminated  from  consideration 
as  being  the  optimal  schedule.  Initially,  all  schedules  are  candidates. 

Definition  2  The  number  of  appointments  scheduled  in  the  itk  time  slot  of  5,  U,  is  the 
ith  component  of  S. 

Definition  3  T  is  a  subschedule  of  5  if  T  represents  any  consecutive  sequence  of  compo¬ 
nents  of  5. 

Definition  4  T  is  an  origin  subschedule  of  5  if  T  is  a  subschedule  of  5  and  the  first  time 
slot  of  T  represents  the  first  time  slot  of  5. 

Definition  5  T  is  a  terminating  subschedule  of  5  if  T  is  a  subschedule  of  S  and  the  last 
time  slot  of  T  represents  the  last  time  slot  of  5. 
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Definition  6  Tx  and  T2  are  relative  if  they  have  the  same  number  of  time  slots  and  the 
same  number  of  appointments. 

Definition  7  7\  and  Tj  are  perfectly  relative  if  they  are  relative,  the  first  appointment  of 
Tx  is  scheduled  at  the  same  time  as  the  first  appointment  of  T3,  and  last  appointment  of 
T\  is  scheduled  at  the  same  time  as  the  last  appointment  of  T3. 

Definition  8  Ti  precedes  T3  if  every  appointment  of  7\  is  scheduled  at  the  same  time  as 
or  before  its  corresponding  appointment  of  T2,  with  at  least  one  appointment  of  Ti  being 
scheduled  before  its  corresponding  appointment  of  T3. 

3.1.4  Problem  Description.  The  simplest  way  to  solve  the  optimal  control  of 
arrivals  problem  would  be  to  enumerate  all  possible  solutions  in  order  to  find  the  best 
one.  However,  for  all  but  the  smallest  problems,  complete  enumeration  is  computationally 
impractical.  Given  N  appointments  to  schedule  in  k  time  units,  the  number  of  possible 
schedules  is  given  by: 

/ N+k- 1 \ 

{  *-1  j 

This  is  the  classic  “N  balls  in  k  cells”  partioning  problem  (10)  which  one  studies  in 
any  introductory  probability  class.  For  example,  a  problem  where  N  =  5  and  k  =  7  has 
462  possible  schedules.  A  problem  where  N  =  8  and  k  =  10,  has  24,310  schedules.  A  larger 
problem  with  25  appointments  and  32  time  units  has  over  5.57  x  1015  possible  schedules, 
so  complete  enumeration  is  not  practical  for  large  problems.  We  will  show  that  we  can 
quickly  eliminate  groups  of  schedules  which  cannot  be  optimal,  and  thus  will  evaluate  a 
much  smaller  number  of  schedules  prior  to  determining  the  optimal  solution.  We  now 
consider  reasons  why  certain  schedules  can  never  be  optimal.  Throughout  this  paper,  we 
will  refer  to  Example  A  as  the  case  where  N  =  5,  k  =  7,  p  =  1,  and  C,  =  4. 

First  of  all,  whether  or  not  a  schedule  can  be  optimal  is  dependent  on  the  value  of 
the  service  rate,  p,  and  the  cost  factor,  which  is  the  ratio  of  overtime  cost  to  waiting  time 
cost.  For  example,  consider  Example  A.  We  will  represent  a  typical  schedule,  such  as  one 
with  one  appointment  scheduled  in  each  of  the  first  five  time  intervals  as  follows: 
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[1111100] 


Now  consider  the  situation  for  Example  A  where  n  is  arbitrary  and  customer  waiting 
cost  is  zero  (the  cost  factor  C,  is  infinite).  In  this  case,  the  optimal  schedule  is  the  one 
that  minimizes  expected  overtime,  which  is  obviously: 

[5000000] 

One  may  think  of  this  as  a  model  of  a  doctor’s  scheduling  system.  Doctors  often  schedule  all 
appointments  at  the  beginning  of  a  time  period.  Thus  they  are  making  the  tacit  assumption 
that  the  ratio  of  the  value  of  their  time  (or  overtime)  to  the  value  of  the  patient’s  time  is 
infinite. 

Conversely,  if  overtime  has  no  cost  associated  with  it,  we  would  schedule  the  appoint¬ 
ments  so  as  to  minimize  expected  waiting  time.  Intuitively  we  would  expect  the  optimal 
schedule  to  be  one  in  which  the  appointments  are  fairly  evenly  spread  out  throught  the 
time  window  (although  the  actual  optimal  schedule  will  depend  on  the  value  of  fi).  Imagine 
a  company  clinic  which  is  staffed  by  salaried  nurses.  Each  worker  that  waits  at  the  clinic 
costs  the  company  money  since  he/she  is  not  working,  and  is  not  receiving  treatment. 
However,  if  the  nurses  work  overtime,  their  is  no  additional  cost  to  the  company  since  the 
nurses  are  on  salary.  In  this  case,  there  certainly  will  be  a  customer  scheduled  in  the  last 
available  time  slot  (assuming  the  nurses  aren’t  the  ones  who  do  the  scheduling). 

The  optimal  schedule  depends  on  the  values  of  n  and  C,.  Based  on  the  values  of  these 
two  parameters,  two  criteria  can  be  used  to  eliminate  candidates:  late-start  scheduling  and 
clustering. 

3.2  Late-Start  Scheduling 

It  is  intuitively  obvious  that  there  would  be  no  advantage  to  scheduling  the  first 
appointment  any  later  than  the  first  time  unit.  This  proposition  is  formally  proved  in  the 
next  chapter.  This  result  eliminates  over  one  half  of  all  schedules  from  consideration  as 
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being  optimal.  The  number  eliminated  is  given  by 


/ N  +  k- 2 \ 

l  ‘-2  ) 

The  number  remaining  is: 

/  JV  +  Jb-2\ 
{  k-3  ) 


3.3  Clustering 

In  almost  any  real-world  situation,  we  would  not  expect  to  schedule  many  appoint¬ 
ments  at  the  exact  same  time  if  N  <  k.  However,  depending  on  the  values  of  the  parameters 
H  and  Ct,  we  can  get  clusters  of  any  size  in  the  optimal  solution.  In  general,  an  extremely 
high  value  of  the  overtime  cost  factor  can  cause  clustering  in  the  early  appointments.  A 
very  small  service  rate  combined  with  a  relatively  low  overtime  cost  factor  can  cause  clus¬ 
tering  in  the  late  appointments.  Since  we  are  scheduling  in  a  finite  time  window  with 
discrete  appointment  times,  we  cannot  be  sure  that  the  optimal  schedule  will  not  have  any 
component  valued  at  m  (i.e.,  an  m-cluster)  scheduled  in  some  time  slot.  We  usually  can 
eliminate  many  schedules  which  contain  specific  m-clusters  from  consideration  as  being 
optimal.  In  order  to  do  this  we  need  an  initial  feasible  solution,  which  can  be  a  judicious 
guess.  Often  a  good  guess  is  a  schedule  which  has  all  of  its  appointments  fairly  evenly 
spread  out  over  the  interval  .  For  Example  A,  we  use  [1101011]  as  our  initial  guess  and 
get  a  total  cost  of  4.47.  From  this  guess  we  can  eliminate  specific  m-clusters. 

Obviously,  any  schedule  with  an  m-cluster  that  contributes  a  total  expected  waiting 
time  cost  of  more  than  4.47  cannot  be  optimal.  A  5-cluster  yields  expected  waiting  time 
of  10//x  time  units.  This  is  true  because  the  expected  waiting  time  of  the  second  customer 
is  l//x,  the  expected  waiting  time  of  the  third  customer  is  2 //*,  the  expected  waiting  time 
of  the  fourth  customer  is  3 /(i,  etc..  Similarly,  a  4-cluster  yields  expected  waiting  time 
of  6  time  units.  Therefore,  no  optimal  schedule  could  ever  contain  either  a  4-cluster  or 
5-cluster. 
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IV.  Foundation 


The  algorithm  is  an  iterative  method  for  determining  the  optimal  solution.  We  start 
by  placing  all  of  the  appointments  in  the  last  time  slot.  We  then  move  one  appointment 
earlier  and  check  for  improvement.  If  the  total  cost  decreases,  this  becomes  our  incumbent 
upper  bound.  We  prove  a  theorem  which  shows  that  any  schedule  with  appointments 
scheduled  later  than  the  new  schedule  cannot  yield  any  improvement.  We  continue  the 
iteration  process  until  we  cannot  get  improvement  by  moving  any  one  appointment  earlier, 
and  then  stop  the  iteration  process.  Next,  we  duplicate  the  process  except  that  we  place  all 
appointments  in  the  first  time  slot  and  move  them  later  via  the  iteration  process.  Again, 
at  each  iteration  step  we  know  that  any  schedule  with  appointments  scheduled  earlier  than 
the  new  schedule  cannot  yield  any  improvement.  We  end  up  with  two  schedules.  No 
optimal  schedule  can  have  an  appointment  which  is  scheduled  later  than  its  corresponding 
appointment  for  the  first  schedule.  Also,  no  optimal  schedule  can  have  an  appointment 
which  is  scheduled  earlier  than  its  corresponding  appointment  for  the  second  schedule. 
Clearly,  if  the  two  schedules  formed  by  the  iteration  process  are  equal,  we  have  the  optimal 
solution.  If  the  two  schedules  are  not  equal,  we  need  only  consider  the  schedules  “between” 
the  two  as  candidate  schedules.  We  then  enumerate  the  remaining  candidate  schedules. 

The  following  proposition  shows  that  every  optimal  schedule  has  at  least  one  ap¬ 
pointment  scheduled  in  the  first  time  slot: 

Proposition  1  Any  optimal  schedule  has  at  least  one  appointment  scheduled  at  tx. 
Proof: 

Let  Si  be  a  schedule  with  its  first  appointment  scheduled  later  than  ti .  Without  loss 
of  generality,  assume  it  is  scheduled  at  t2.  Now  consider  S2,  where  each  appointment  of  S2 
is  scheduled  one  unit  earlier  than  the  corresponding  appointment  of  Si.  Clearly,  W[SX]  = 
W[Sa]  and  0[SX]  >  0[S2].  Hence  Sx  cannot  be  optimal. 

We  introduce  the  following  Lemma  which  is  used  in  the  proofs  of  the  upcoming 
theorems: 
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Lemma  1  Let  Tx  and  T2  be  two  relative  subschedules  of  m  appointments  and  assume  7\ 
precedes  T2.  Define  Pi(»)  and  P2(i)  as  the  probabilities  that  there  are  i  customers  in  the 
system  for  Tx  and  T2  respectively.  Then  immediately  after  the  mtk  customer  of  T2  enters 
the  system,  the  following  hold: 

Pi(m)  <  P2(m). 

Pi(m)  +  Pi(m  -  1)  <  P2(m)  +  P2(m  -  1). 


Pi(m)  +  Pi(m  -  1)  H - +  Pi(l)  <  P2(m)  +  P2(m  -  1)  +  •  •  •  +  P2(l). 

At  the  time  of  the  mth  customer  arrival  am ,  the  probability  that  there  are  m  customers 
in  the  system  is  equal  to  the  probability  that  the  first  customer  is  still  in  service.  Similarly, 
the  probability  that  there  are  m  —  l  customers  in  the  system  is  equal  to  the  probability 
that  the  first  l  customers  have  been  served  and  the  (/  +  1)“  customer  is  still  in  service. 

Define  Q(i)  as  the  probability  that  no  more  than  i  customers  have  been  served. 
For  example,  Q(3)  is  the  probability  that  0,1, 2, or  3  customers  have  been  served.  Thus, 
Pj(m)  =  Qi(0),  Pi(m)  +  Pi(m  -  1)  =  Q(l),  Pi(m)  +  Pi(m  -  1)  +  •  •  •  +  Pi(m  -  /)  =  Q(l), 

and  Pi(m)  +  Pi(m  -  1)  + - b  Pi(l)  =  Q(m  ~  !)•  Clearly,  since  every  customer  of  Tx  is 

scheduled  no  later  than  its  corresponding  customer  of  T2,  the  probability  that  i  or  fewer 
customers  of  Tx  have  been  served  cannot  be  larger  than  the  corresponding  probability  for 
T2,  for  any  i  =  0,  1. 

The  following  theorem  and  its  corollaries  compare  the  amount  of  increase/decrease 
in  expected  time  which  results  from  moving  an  appointment  one  time  slot  later  or  earlier 
(It  is  obvious  via  an  inductive  argument  that  the  results  hold  when  moving  appointments 
any  integral  number  of  time  slots  also).  These  theorems  are  the  basis  for  the  foundation  of 
the  algorithm,  since  they  guarantee  that  under  certain  conditions  we  can  eliminate  entire 
classes  of  schedules  from  consideration  as  being  optimal. 

Theorem  1  Assume  service  time  follows  an  r-Erlang  distribution  with  customer  service 
rate  /z.  Let  7\  and  T2  be  two  relative  subschedules  of  m  appointments  and  k  time  slots. 
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Assume  the  last  appointment  of  Tx  is  scheduled  at  the  same  time  as  the  last  appointment 
of  Tj,  and  Tx  precedes  T2.  Form  T3  by  moving  the  last  appointment  of  Tx  one  time  slot 
later.  Form  T4  by  moving  the  last  appointment  of  T2  one  time  slot  later.  Then  W[7\]  - 
W[T3]  <  W[T2]  -  W[T4] 

Example: 


Ti  =  [2111101]  and  T2  =  [2111011] 

T3  =  [21111001]  and  T4  =  [21110101] 

Proof: 

Consider  Tx  and  T3.  The  expected  waiting  time  of  each  appointment  of  Tx  is  the 
same  as  the  expected  waiting  time  of  its  corresponding  appointment  of  T3  except  for 
dm.  Similarly,  the  expected  waiting  time  of  each  appointment  of  T2  is  the  same  as  the 
corresponding  appointment  of  T4,  except  for  the  a^.  Hence,  when  we  look  at  W[TX]-W[T3] 
and  W[T2]  -  W[TA ]  ,  we  need  only  consider  the  differences  in  expected  waiting  time  of  the 
mth  appointments  of  each.  To  obtain  these  expected  waiting  times,  we  need  consider 
Px(i)  and  P2{ *),  the  probability  there  are  exactly  »  stages  of  customer  work  in  the  system 
immediately  prior  to  when  customer  m  enters  service. 

Clearly,  the  conditions  of  Lemma  1  hold.  Define  q(i)  as  the  probability  there  are 
exactly  i  stages  of  service  in  the  time  interval  between  the  original  scheduled  time  of 
the  mtk  appointment  and  the  newly  scheduled  time  of  the  mth  appointment.  Note  these 
probabilities  are  identical  for  T2  and  T4.  Furthermore,  by  the  memoryless  property  of  the 
exponential  distribution,  these  probabilities  are  independent  of  the  number  in  the  queue. 
Since  each  customer  has  r  exponentially  distributed  phases  of  service,  the  expected  waiting 
times  of  Om  become: 

Wi[am]  =  Pi(rm  -  r)  *  ( rm  -  r)/r/x  + - f  Pi(l)  *  l/rp 

W^Oro]  =  Pi{rm-r)*q(0)*(rm-r)/rfi+- •  -+Pi(l)*q(rm-r-l)*l/rii+Px(l)*q(0)*l/rn 
Wsfom]  =  Pi(rm  -  r)  *  (rm  -  r)/rn  +  •  •  •  +  P2(  1)  *  1/rfi 
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W4[om]  =  P2(rm-r)*q(0)*(rm-r)/r/i+-  ■  +P3(l)*q(rm-r-l)*l/rfi+P3(l)*g(0)*l/rfi 


From  these  equations,  we  calculate  the  difference  (W[T2]  -  W[T4])  -  (W[Ti]  -  W[T3])  = 

(P2(rm  -  r)  -  Px(rm  -  r))  *  (1  -  (g(0)  +  ■  •  •  +  q(rm  -  r  -  1)))  *  1/r/H- 

(P3(rm-r)+P2(rm-r-l)-Pi(rm— r)-i,i(rm-r-l))*(l-(g(0)H - |-g(rm-r-2)))*l/r/i 

+(P2(rm  -  r)  +  •  •  •  +  P2(l)  -  Pi(rm  -  r) - Pi(l))  *  (1  -  g(0))  *  1/r/x 

which  must  be  a  positive  number.  Therefore 

(W [T2]  -  W[TJ)  >  (W[TJ  -  W[TS]) 

Corollary  1  Let  Tx  and  T3  be  two  perfect  relative  subschedules  of  m  appointments  which 
are  origin  subschedules  of  5 1  and  S2  respectively.  Sx  and  S2  are  relative  schedules  of  k 
appointments  and  5i=[T1|T],S2=[T2|T]  for  some  T.  Assume  Tx  precedes  T2.  Form  S3 
by  moving  the  last  appointment  of  Tx  n  time  units  later  (but  not  passing  the  succeeding 
appointment).  Form  54  by  moving  the  last  appointment  of  T2  n  time  units  later  (but  not 
passing  the  succeeding  appointment).  Then  0*[S3]  -  0*[Si]  >  0*[54]  -  0*[52],  where 
0*[5]  =  Wlan+x]  +  •  •  •  4-  W[ak]  +  0[S}. 

Corollary  2  Let  Tx  and  T2  be  two  perfect  relative  subschedules  of  m  appointments  which 
are  terminating  subschedules  of  Sx  and  S2  respectively.  Si  and  52  are  relative  schedules 
of  k  appointments  and  S'i=[2t|!Ti],52=(T|T2]  for  some  T.  Assume  Tx  precedes  T2.  Form 
S3  by  moving  the  last  appointment  of  T  (in  Sx)  n  time  units  later  (but  not  passing  the 
succeeding  appointment).  Form  54  by  moving  the  last  appointment  of  T  (in  S2)  n  time 
units  later  (but  not  passing  the  succeeding  appointment).  Then  0*[S3]  -  0*[5j]  >  0*[S4] 
-  0*[52],  where  0*[5]  =  Ifk+1]  +  •  •  •  +  W[ak]  +  0[S]. 
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V.  Algorithm 


5. 1  Methodology 

For  any  problem  we  now  have  criteria  which  allows  us  to  eliminate  many  candidate 
schedules.  Recall  Example  A  and  consider  the  one  schedule  which  places  each  appointment 
at  its  latest  allowable  scheduled  time.  We  shall  call  this  schedule  the  latest  schedule  and 
represent  it  as  L *.  Initially,  L *  =  [0000005].  The  late  start  criteria  would  require  L' 
to  become  [1000004].  After  an  initial  guess  of  [1101110]  to  get  an  upper  bound  on  total 
expected  cost  (as  seen  earlier),  the  clustering  criteria  would  then  imply  L*  =  [1000013]. 
We  will  use  the  initial  L\  to  iteratively  select  a  sequence  of  schedules  LC  each  with  the 
property  that  no  candidate  schedule  can  have  any  appointment  scheduled  later  that  its 
corresponding  position  of  Li*. 

Given  the  current  Li* ,  consider  moving  one  appointment,  say  at,  one  unit  earlier  to 
form  L' .  If  the  total  expected  cost  of  L'  is  less  than  the  total  expected  cost  of  Li* ,  then 
clearly  Z,*  is  no  longer  a  candidate.  Furthermore,  if  any  terminating  subschedule  which 
begins  with  Oj+1  replaces  the  corresponding  subschedule  of  L*,  moving  the  itK  appointment 
will  result  in  a  schedule  with  higher  total  expected  cost  than  that  of  L' .  Remember,  by 
moving  a*  one  unit  earlier,  the  expected  waiting  time  of  a*  will  increase,  and  O*  will 
decrease.  This  increase  will  be  the  same  in  both  cases,  but  by  Corollary  2,  the  decrease  in 
O*  is  less  than  between  LC  and  L  .  Hence  no  candidate  schedule  can  have  any  appointment 
scheduled  later  than  where  it  is  scheduled  in  L  . 

If  we  keep  iterating  the  above  process,  we  will  get  to  a  point  where  moving  any 
appointment  one  unit  earlier  will  cause  total  expected  cost  to  increase.  Therefore,  we 
have  determined  the  latest  possible  time  at  which  any  appointment  can  be  scheduled. 
Next,  we  repeat  the  process.  We  will  use  an  initial  L\‘  to  iteratively  select  a  sequence  of 
schedules  Li**  each  with  the  property  that  no  candidate  schedule  can  have  any  appointment 
scheduled  earlier  that  its  corresponding  position  of  Li* . 

Again,  given  the  current  Li** ,  consider  moving  one  appointment,  say  a*,  one  unit  later 
to  form  L  .  If  the  total  expected  cost  of  L'  is  less  than  the  total  expected  cost  of  Z,“,  then 
clearly  Li**  is  no  longer  a  candidate.  Furthermore,  if  any  terminating  subschedule  which 
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ends  with  a*+i  replaces  the  corresponding  subschedule  of  L*m ,  moving  the  itk  appointment 
will  result  in  a  schedule  with  higher  total  expected  cost  than  that  of  L' .  By  moving  a* 
one  unit  later,  the  expected  waiting  time  of  Oi  will  decrease,  and  O’  will  increase.  This 
decrease  will  be  less  for  any  preceding  subschedule  and  by  Corollary  2,  the  increase  in 
O*  will  be  more  when  the  the  initial  subschedule  is  a  preceding  subschedule.  Hence  no 
candidate  schedule  can  have  any  appointment  scheduled  earlier  than  where  it  is  scheduled 
in  L  .  We  continue  this  procedure  until  we  satisfy  our  stopping  criteria. 

5.2  Stopping  Criteria 

When  the  first  iteration  phase  reaches  the  point  where  no  improvement  is  achieved 
by  moving  any  appointment  one  time  slot  earlier,  we  then  begin  the  second  iteration  phase. 
If  the  same  schedule  is  the  solution  to  both  iterations,  then  we  clearly  have  the  optimal 
schedule  since  each  appointment  is  scheduled  at  both  its  earliest  and  latest  possible  times. 
If  the  two  schedules  are  different,  then  we  must  evaluate  all  schedules  which  have  appoint¬ 
ments  that  lie  between  the  latest  possible  and  earliest  possible  scheduled  times.  In  most 
of  the  cases  we  have  evaluated,  the  iteration  processes  lead  to  the  optimal  solution.  In  the 
cases  where  they  were  not  the  same,  the  two  schedules  differed  by  at  most  8  appointments 
(for  a  problem  with  25  appointments  and  32  time  slots).  Moreover,  for  each  problem  we 
have  tested,  one  of  the  two  iteration  phase  schedules  has  been  the  optimal  one.  In  general, 
if  the  two  iteration  phase  schedules  differ  by  m  appointments,  there  will  be  no  more  than 
2m  remaining  candidate  schedules  to  consider.  It  is  important  to  note  that  if  a  situation 
requires  an  immediate  solution,  one  iteration  phase  will  most  certainly  give  a  schedule  in 
a  timely  manner  which  is  close  to  the  optimal  one. 

There  are  several  approaches  we  can  take  in  the  iteration  processes,  since  we  can  move 
up  to  N  —  1  appointments  of  the  current  incumbent  bound  (Li*).  For  ease  in  the  coding  of 
the  algorithm,  we  have  decided  to  move  each  one  and  then  form  Li+1*  by  moving  the  one 
which  results  in  the  best  improvement.  Another  approach  would  be  to  move  latest  (earliest) 
appointment  and  see  if  it  yields  improvement.  If  it  does,  use  that  schedule  for  Li+ x*,  if 
not,  move  the  next  latest  (earliest)  appointment,  etc...  The  former  approach  would  result 
in  the  evaluation  of  more  schedules,  but  the  latter  approach  would  require  more  iterations 
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of  checking  whether  or  not  you  get  improvement  by  moving  one  appointment.  Since  either 
method  only  requires  the  evaluation  of  a  small  subset  of  the  original  candidate  schedules, 
we  feel  that  the  first  method  is  efficient  enough  and  also  gives  more  sensitivity  analysis  if 
the  schedules  from  the  last  few  iterations  are  observed. 

Using  our  first  method,  we  could  have  at  most  (N  -  1)  *  (k  -  1)  iterations  for  each 
phase,  and  in  each  iteration  we  will  evaluate  at  most  (Jb — 1)  schedules.  Hence,  the  maximum 
number  of  schedules  to  calculate  is  2*(ife  -  1)J*(1V  —  1).  In  practice,  we  will  always  calculate 
many  fewer.  The  only  way  one  could  achieve  a  number  near  this  maximum  would  be  if 
the  expected  waiting  cost  is  practically  zero.  Nevertheless,  if  for  N  =  25,  and  k  =  32, 
the  number  of  feasible  schedules  is  over  5.57*  1015,  while  the  algorithm  could  theoretically 
require  the  calculation  of  at  most  23,064  schedules  for  each  phase.  If  the  two  phases  are 
solved  simultaneously,  we  would  start  out  with  the  same  initial  upper  bound  for  each  one. 
If  they  are  done  in  succession,  we  will  have  a  very  good  starting  point  from  the  first  phase 
solution  and  hence  can  use  it  for  the  second  phase.  Generally,  the  phase  where  we  move 
appointments  to  the  right  converges  much  more  rapidly  than  when  move  appointments  to 
the  left.  Thus,  if  these  phases  are  done  in  succession,  it  would  be  better  to  get  the  earliest 
possible  appointments  and  use  the  total  expected  cost  to  get  an  initial  guess  for  the  phase 
of  the  algorithm  which  determines  the  latest  possible  appointments. 

If  the  two  phases  of  the  algorithm  yield  different  solutions,  then  we  must  enumerate 
the  remaining  schedules  in  order  to  determine  if  there  is  a  better  schedule  than  our  best 
so  far.  In  all  of  the  examples  we  investigated,  we  found  at  most  eight  apppointments  that 
were  different  between  the  two  phases  (in  the  cost  measured  as  overtime  case).  Thus,  com¬ 
plete  enumeration  would  require  the  calculation  of  at  most  28  =  256  additional  schedules. 
However,  it  is  reasonable  to  assume  that  an  example  could  occur  where  the  two  solutions 
differed  by  many  more  appointments.  If  the  number  of  schedules  remaining  to  be  calcu¬ 
lated  is  large,  then  we  would  have  to  use  some  branch  and  bound  or  implicit  enumeration 
technique  to  eliminate  large  numbers  of  candidate  schedules  quickly.  We  could  use  our  best 
solution  as  an  initial  lower  bound  for  the  branch  and  bound  technique  developed  by  Liao 
(9).  In  fact,  our  initial  lower  bound  may  indeed  be  achieved  more  quickly  than  with  the 
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dynamic  programming/branch  and  bound  techniques  employed  by  Liao.  Moreover,  one  of 
his  recommendations  is  for  a  better  technique  for  establishing  an  initial  lower  bound. 

An  additional  benefit  of  the  algorithm  is  that  it  can  be  used  to  determine  potential 
gain  by  using  a  smaller  time  increment  for  the  schedule.  For  example,  if  N  =  5  and  k  =  7, 
we  might  want  to  know  if  there  is  any  advantage  to  doubling  the  number  of  time  slots 
but  making  each  one  half  the  length  of  the  original  ones.  This  reiteration  of  the  algorithm 
could  require  the  calculation  of  at  most  (2k  -  l)2  *  (N  -  1)  schedules  for  each  iteration 
phase  if  run  from  the  start.  However,  we  can  use  information  from  the  incumbent  optimal 
solution  to  establish  a  good  upper  bound,  and  the  incumbent  solution  has  been  established 
with  the  new  time  slots,  we  move  each  appointment  two  new  units  to  the  later  (earlier). 
Clearly,  this  schedule  satisfies  all  requirements  for  L*  in  the  algorithm.  We  note  that  it 
will  be  necessary  to  determine  the  subdivision  increments  based  on  the  prime  factorization 
of  the  time  interval. 

It  is  important  to  note  that  the  maximum  number  of  schedules  required  to  calculate 
at  each  step  grows  only  linearly.  In  fact,  at  each  step  we  need  calculate  no  more  than 
2*1*  N  schedules,  where  l  =the  number  of  subdivisions  of  the  previous  time  slot.  For  this 
reason,  the  algorithm  is  also  an  efficient  method  to  get  an  approximation  to  the  continuous 
time  versions  of  the  problem.  If  we  halve  our  interval  at  each  iteration  step,  we  will  reach 
machine  zero  at  a  relatively  small  number  of  iterations.  Since  the  complexity  of  algorithm 
only  grows  linearly,  we  can  reach  an  approximation  to  the  continuous- time  solution  with 
the  calculation  of  only  a  relatively  small  number  of  candidate  schedules. 

There  are  two  numerical  reasons  why  the  algorithm  only  gives  an  approximate  so¬ 
lution  to  the  continuous  problem.  First,  as  we  shrink  the  size  of  the  time  slots,  there  is 
a  greater  liklihood  that  the  two  iteration  steps  will  yield  solutions  which  differ  by  many 
appointments,  thus  making  enumeration  impractical.  Additionally,  since  we  are  exponen¬ 
tiating  extremely  small  numbers,  the  two  iteration  processes  will  have  built  up  different 
amounts  of  machine  error,  again  causing  the  two  solutions  to  differ  by  many  time  slots. 


17 


5.3  Sample  Problem 

Consider  our  Example  A.  For  these  values  of  the  parameters,  we  have  seen  that 
we  can  quickly  eliminate  4  and  5-clusters  from  consideration.  Therefore,  we  start  out 
with  [1000013]  as  L' .  We  then  check  the  value  of  the  schedule  formed  by  moving  each 
appointment  one  unit  left.  We  will  accept  the  schedule  which  results  in  the  lowest  total 
cost.  The  following  lists  the  sequence  of  schedules  which  were  chosen: 

[1000013]  Total  Expected  Cost:  13.68 
[1000103]  Total  Expected  Cost:  12.10 
[1000112]  Total  Expected  Cost:  9.54 
[1001012]  Total  Expected  Cost:  8.38 
[1001102]  Total  Expected  Cost:  7.61 
[1001111]  Total  Expected  Cost:  6.34 
[1010111]  Total  Expected  Cost:  5.47 
[1011011]  Total  Expected  Cost:  5.02 
[1101011]  Total  Expected  Cost:  4.74 
[1101101]  Total  Expected  Cost:  4.42 
[1110101]  Total  Expected  Cost:  4.35 

[1110110]  Total  Expected  Cost:  4.10 

Next,  we  perform  the  second  iteration  process. 

The  following  are  the  phase  two  results: 
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[3110000]  Total  Expected  Cost:  8.27 


[3101000]  Total  Expected  Cost:  7.53 
[2201000]  Total  Expected  Cost:  6.76 
[2111000]  Total  Expected  Cost:  5.96 
[2101100]  Total  Expected  Cost:  5.06 
[2011100]  Total  Expected  Cost:  4.79 


[1111100]  Total  Expected  Cost:  4.48 
[1111010]  Total  Expected  Cost:  ^.17 
[1110110]  Total  Expected  Cost:  4.10 

Since  the  two  iteration  phases  yield  identical  schedules,  we  have  the  optimal  solution. 

Out  of  the  462  possible  schedules,  we  only  calculated  66  in  order  to  get  the  phase 
one  solution. 
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VI.  Examples 


We  present  some  sample  problems  with  a  variety  of  parameters.  These  examples 
illustrate  how  the  algorithm  performs  with  different  distributions  and  various  combinations 
of  numbers  of  appointments  and  numbers  of  time  slots. 

6.1  k=15,  N--=40 

The  following  two  examples  represent  problems  where  there  are  many  more  time 
slots  than  appointments. 

CASE  I:  p  =  1,  C  =  3,  r  =  1 

Both  iteration  processes  yield  the  same  schedule: 

[1010010100100101001001010010010100100100] 

This  is  the  optimal  solution.  The  objective  function  value  is  1.69  .  Out  of  the 
8.65  *  101J  possible  schedules,  7686  schedules  were  evaluated. 

CASE  H:  p  =  1,  C  =  3,  r  =  2 

The  latest  candidate  schedule  is:  [1010010100100101001001010010010100100100]  The 
objective  function  value  is:  .43659 

The  earliest  candidate  schedule  is:  [1010010010100100101001001010010010100100] 
The  objective  function  value  is:  .43646 

The  two  schedules  are  identical  except  for  the  4tfc,  7th,  10‘A,  and  13th  appointments. 
Therefore,  we  only  need  to  evaluate  the  schedules  which  result  from  moving  combinations 
of  these  appointments.  Moreover,  we  don’t  need  to  check  the  schedules  formed  by  moving 
exactly  one  appointment,  exactly  three  appointments  or  exactly  four  appointments.  We 
have  already  checked  the  ones  formed  by  moving  one  appointment.  Moving  three  appoint¬ 
ments  from  one  of  the  two  candidates  is  equivalent  to  moving  one  on  the  other.  Moving  all 
four  would  give  the  other  candidate.  Hence,  we  only  need  to  evaluate  all  schedules  formed 
by  moving  exactly  two  appointments,  and  there  are  6  of  these  schedules. 

None  of  these  schedules  we  enumerated  had  a  lower  total  expected  cost  than  either  of 
our  schedules  formed  via  the  iteration  processes.  Thus,  the  optimal  schedule  is  the  earliest 
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candidate  schedule  above,  and  the  objective  function  value  is  .43646.  8064  schedules  were 
evaluated  in  the  iteration  processes,  plus  6  in  the  enumeration  process  for  a  total  of  8070. 

6.2  k=20,  N=16 

The  following  two  examples  represent  problems  where  there  are  about  the  same 
number  of  time  slots  as  appointments. 

CASE  I:  n  =  1,  C  =  0,  r  =  2 

Both  iteration  processes  yield  the  same  schedule:  [11101101101101110112]  The  ob¬ 
jective  function  value  is  7.11.  This  is  the  optimal  solution.  Out  of  the  4.06  *  109  possible 
schedules,  4275  schedules  were  evaluated. 

CASE  H:  n  =  1,  C  =  50,  r  =  3 

Both  iteration  processes  yield  the  same  schedule:  [11111111101111011100]  The  ob¬ 
jective  function  value  is  15.07.  This  is  the  optimal  solution.  4275  schedules  were  evaluated. 

6.3  k=32,  N—25 

The  following  two  examples  represent  a  larger  scale  problem  with  many  appointments 
and  many  time  slots. 

CASE  I:  n  =  1,  C  =  25,  r  =  1 

The  latest  candidate  schedule  is:  [21111011110111101111011101110100]  The  objec¬ 
tive  function  value  is:  46.58 

The  earliest  candidate  schedule  is:  [21111101111011110111011101110100]  The  objec¬ 
tive  function  value  is:  46.60 

These  two  schedules  are  identical  except  for  the  6th,  10th,  and  14th  appointments.  We 
already  know  the  schedules  formed  by  moving  one  appointment  are  not  candidates,  hence 
the  schedules  formed  by  moving  two  appointments  Eire  not  candidates  either,  since  it  is 
identical  to  a  schedule  formed  by  moving  one  appointment  in  the  other  iteration.  Clearly 
moving  all  three  produces  the  other  iteration  schedule.  Thus,  the  optimal  schedule  is  the 
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latest  candidate  schedule  above,  and  the  objective  function  value  is  46.58.  23653  schedules 
were  evaluated. 

CASE  H:  n  =  1,  C  =  100,  r  =  2 

Both  iteration  processes  yield  the  same  schedule:  [21111011111101111011110111011000] 
The  objective  function  value  is  32.73.  This  is  the  optimal  solution.  24087  schedules  were 
evaluated. 

6.4  Server  Shuts  Down,  k=20,  N=16 

In  this  situation,  server  time  is  measured  as  the  length  of  time  from  when  the  finite 
time  horizon  starts  until  the  expected  time  that  the  last  customer  departs  service.  Service 
cost  is  measured  as  the  cost  per  unit  multiplied  by  the  expected  server  time.  Again,  we 
need  only  consider  the  ratio  of  customer  waiting  cost  to  server  cost.  We  first  check  an 
example  with  server  cost  is  0  in  order  to  see  we  get  the  same  result  as  when  server  cost  is 
measured  as  overtime,  and  server  cost  equals  0. 

CASE  I:  n  =  1,  C  =  0,  r  =  2 

Both  iteration  processes  yield  the  same  schedule:  [11101101101101110112]  The  ob¬ 
jective  function  value  is  7.11.  This  is  the  optimal  solution.  Out  of  the  4.06  *  109  possible 
schedules,  4275  schedules  were  evaluated. 

CASE  II:  n  =  1,  C  =  5,  r  =  2 

As  expected,  our  answer  is  different  from  the  overtime  cost  example.  The  latest 
candidate  schedule  is:  [11111110111110111100].  The  objective  function  value  is  111.90 

The  earliest  candidate  schedule  is:  [11111111111111110000].  The  objective  function 
value  is:  112.66 

If  we  assume  there  will  be  no  two  cluster,  there  50  additional  schedules  to  calculate. 

If  not,  there  are  211  to  consider.  After  enumerating  all  2U  schedules,  we  see  that  the  latest 
candidate  schedule  is  the  optimal  one. 
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6.5  Continuous  Case,  k=7,  N=5,  n=l,  C,  =4 

We  use  the  algorithm  to  get  an  approximation  to  the  continuous  problem  of  our 
Example  A.  The  program  halved  the  given  time  slots  and  solved  with  the  smaller  intervals 
308  times. 

The  latest  candidate  schedule  is  :[0,  .12236,  .32081,  .52981,  .74116] 

The  earliest  candidate  schedule  is  :[0,  .12234,  .32079,  .52972,  .74104] 

The  objective  function  value  for  both  is:  3.98251,  and  was  identical  for  all  13  decimal 
places  of  each  answer.  We  assume  machine  error  will  be  so  varied  between  the  two  iteration 
phases  that  getting  a  very  precise  approximation  will  be  difficult.  However,  we  have  an 
approximation  correct  to  3  decimal  places.  Also,  we  have  a  small  neighborhood  where  we 
know  each  appointment  must  be  scheduled.  Hence  the  algorithm  is  useful  in  approximating 
the  solution  to  the  continuous  problem.  Each  iteration  phase  stopped  after  there  were  over 
lO308  subintervals  created. 
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VII.  Conclusions  and  Recommendations 


Our  algorithm  is  a  very  efficent  method  for  solving  the  optimal  control  of  arrivals 
problem.  The  algorithm  solves  the  problem  for  the  case  where  server  cost  is  measured  as 
expected  overtime  cost,  as  well  as  the  case  where  server  time  is  measured  as  the  difference 
in  time  between  when  the  server  starts  and  when  the  server  shuts  down.  The  only  difference 
will  be  in  the  cost  factor  and  how  the  server  cost  is  measured. 

The  algorithm  can  likely  be  extended  to  the  following  cases: 

•  Multiple  parallel  servers  with  r- Erlang  distributed  service  time. 

•  Multiple  servers  in  sequence  each  with  r-Erlang  distributed  service  time. 

•  Several  classes  of  customers  in  the  system,  each  class  having  different  k-Erlang  wait¬ 
ing  time  distributions  and  waiting  cost  structures. 

•  All  of  the  above  cases  where  service  time  follows  a  general  distribution. 

The  theorems  appear  extendable  to  most  nice  distributions.  Hence  it  seems  likely 
that  the  algorithm  in  the  single  server  example  would  work  with  any  unimodal  distribu¬ 
tion  for  service  time.  Also,  the  methodology  appears  to  be  fully  extendable  to  to  the  cases 
of  multiple  servers  and  classes  of  customers,  although  the  computer  record  keeping  may 
slow  down  the  efficiency,  particularly  when  there  axe  multiple  classes  of  customers.  Addi¬ 
tionally,  the  algorithm  appears  to  work  for  approximating  continuous-time  versions  of  the 
aforementioned  problems  as  well.  Extensions  of  this  research  effort  are  needed  to  verify 
the  applicability  of  tb(  algorithm  to  the  additional  cases. 
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Appendix  A.  Alternate  Proofs 


A.l  Alternate  Proof  of  Theorem  1 

Theorem  1  Let  Tx  and  T2  be  two  relative  subschedules  of  m  appointments  and  k 
time  slots,  and  assume  7\  precedes  T2.  Form  T3  by  moving  the  last  appointment  of  Tx  n 
time  units  later.  Form  T4  by  moving  the  last  appointment  of  T2  n  time  units  later.  Then 
W ~  W[T3]  <  W[T2]  -  W[T4] 

Proof:  We  know  that  Wi^]  <  The  total  time  to  complete  service,  xx,  for 

each  customer  already  in  the  queue  for  Ti  is  distributed  according  to  a  Gamma  distribution 
with  parameters  rx  —  Wifom]  and  0  =  p.  Similarly,  the  total  time  to  complete  service, 
z2,  for  each  customer  already  in  the  queue  for  T2  is  distributed  according  to  a  Gamma 
distribution  with  parameters  r2  =  W2{a~m\  and  0  =  p.  It  is  a  fact  that  if  two  Gamma 
distributions  with  cumulative  distribution  functions  rx  and  T2  have  the  same  0  parameter 
and  rx  <  r2,  then  r2(f)  >  rx(f)  for  all  t  >  0  over  any  time  interval.  Therefore  the  difference 
in  the  expected  number  of  customers  served  by  moving  the  last  appointment  of  7\  later  is 
always  less  than  the  difference  in  the  expected  number  of  customers  served  by  moving  the 
last  appointment  of  T2  later. 

A. 2  Alternate  Proof  of  Corollary  1 

Corollary  1  Let  Tx  and  T2  be  two  perfect  relative  subschedules  of  m  appointments 
which  are  origin  subschedules  of  Si  and  S2  respectively.  Sx  and  52  are  relative  schedules 
of  k  appointments  and  SX=[TX|T],52=[T2|T]  for  some  T.  Assume  Tx  precedes  T2.  Form  S3 
by  moving  the  last  appointment  of  Tx  n  time  units  later  (but  not  passing  the  proceeding 
appointment).  Form  S4  by  moving  the  last  appointment  of  T2  n  time  units  later  (but  not 
passing  the  proceeding  appointment).  Then  0*[S3]  -  0*[5X]  >  0*[S4]  —  0*[52]  where 
0*[S]  =  W[am+1]  +  •  •  •  +  W[ak]  +  0[S}. 

Proof:  As  seen  in  the  proof  of  Theorem  1  the  total  time  xx  to  complete  service  for  each 
customer  already  in  the  queue  for  Tx  is  distributed  according  to  a  Gamma  distribution  with 
parameters  rx  =  Wx  [a™]  and  0  =  p.  Similarly,  the  total  time  z2  to  complete  service  for  each 
customer  already  in  the  queue  for  T2  is  distributed  according  to  a  Gamma  distribution  with 
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parameters  ri  =  Wi[on]  and  0  =  ft,  where  r2(t)  >  Tx(t)  for  all  t  >  0.  Hence  E[x3]  >  E[x j) 
over  any  time  interval.  Consider  the  cumulative  distribution  Ft  of  the  number  not  served  in 
Tx  over  any  time  interval  (0,  t),  which  will  be  the  same  as  Fx(t).  Similarly,  the  distribution 
Fj  of  the  number  not  served  in  T2  over  that  same  time  interval,  will  be  equal  to  ra(t). 
Clearly,  Fi  is  always  greater  than  or  equal  to  F2,  which  implies  the  difference  in  expected 
waiting  time  of  the  ( m  + 1)*‘  customer  after  moving  the  mth  customer  of  Tj  later  is  greater 
then  the  difference  in  expected  waiting  time  of  the  (m  + 1)*‘  customer  after  moving  the  m,h 
customer  of  T2  later.  Since  Tx  precedes  Ta,  and  W^xfam+j]  <  t  =  1, ...,  k  -  m  the 

theorem  wiU  hold  for  every  appointment  succeeding  dm,  as  well  as  for  expected  overtime. 
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Appendix  B.  Computer  Code 
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*  THIS  CODE  FINDS  EARLIEST  CANDIDATE  SCHEDULE -  SERVICE  -  r-ERLANG 

*  SERVER  COST  MEASURED  AS  OVERTIME 

REAL* 8  X (200, 200) ,Y (200, 200) ,P (200, 200) ,Q (200, 200) ,W(200) 
REAL* 8  U,  SUM,  SUM1 ,  SUM2 ,  GG 

REAL* 8  WAIT, STORE, C, OT, TEMP , FACT, BEST, VAL, OLDBEST, TOTAL, N 
REAL*8  NAPT, NSLT, CHECK, CUSMU, STAGES, BWAIT,  BOT 
INTEGER  I, A, J, D, L, K,M, Z, ARF 
OPEN  (UNIT-2,  FILE-' algol. out ' ) 

BEST-10000000. 

OLDBEST-1 000000. 

ARF— 0 

*  INPUT  PARAMETERS 

N-25 . 

NSLT-32 . 

C-0. 

STAGES— 2 . 

CUSMU-  1. 

WRITE (2,*)  STAGES,  '-Erlang'  ,'  U-' ,  CUSMU,  N,  '  CUSTOMERS' 

WRITE (2,*)  'Cost  Factor  «  ',  C, ' server  cost  is  overtime' 

WRITE (2,*)  '#  Of  Slots  =  ',  NSLT 

U-CUSMU* STAGES 

TOTAL— N+l 

NAPT-N* STAGES 

DO  1  F— 1 , NAPT+1 . 

DO  2  G=l, F 
P  (F,  G)  —0 . 

Q  (F,  G)  —0 . 

2  CONTINUE 

1  CONTINUE 

*  INITIALIZE  FIRST  SCHEDULE 
DO  3  G— 1,  TOTAL 

DO  434  CC=1,  N  APT-1 . 

X (G, CC) —0 . 

CONTINUE 
X (G, NAPT) =NSLT 
CONTINUE 
DO  2000  A=1 , N-l . 

DO  11  B=1 , NAPT 

Y  (A,  B)  =X  (A,  B)  *U 
CONTINUE 

Z— 0 

next  calculate  the  P  probabilities 
DO  201  1=1, NAPT 
Z=Z+1 
SUM=0. 

FACT-1 . 

DO  101  J=1,I 

P  (I,  J)  =EXP  (-Y  (A,  Z)  )  *  (  (Y  (A,  Z)  **  ( J-l)  )  /FACT) 

SUM-SUM+P (I, J) 

FACT-FACT* ( J) 

CONTINUE 
P(I,I+1)= 1. -SUM 
CONTINUE 

calculate  the  Q  probabilities 
Q(1,2)=P(1,1) 

Q (1 , 1) =1-Q (1,2) 

DO  10  K—2 , NAPT 
SUM1-0. 

DO  12  L— 1 , K 
SUM2-0 . 

TEMP-0 . 

D— 1 

DO  14  M-L,  K 

TEMP-P (K, D) *Q (K-l , M) 


434 

3 

130 

11 

* 

★ 

101 

201 

* 

* 


14 


12 

10 


7 


44 

33 


555 

55 


241 

2000 


40 

30 


2468 

888 

1746 

1747 


SUM2-SUM2+TEMP 
D-D+l 
CONTINUE 
Q(K,L+1)-SUM2 
SUM1-SUM1+SUM2 
CONTINUE 
Q  (K,  1) =1 . -SUM1 
CONTINUE 
DO  7  R“1 , NAPT 
W(R)  -0. 

CONTINUE 
DO  33  E-l, NAPT 
STORE-O . 

DO  44  F-2,E+1 

STORE-Q(E,F) * (F-l) /U 
W (E) — W (E) +STORE 
CONTINUE 
CONTINUE 
WAIT-0 . 

OT-O . 

CHECK-1 . 

DO  55  G— 1 , NAPT-1 

DO  555  GG— 1 . , NAPT 

IF  ( (CHECK/ STAGES ) .EQ.  GG)  WAIT-W (G) +WAIT 
CONTINUE 
CHECK— CHECK+ 1 . 

CONTINUE 
OT— W (NAPT) *C 
VAL-WAIT+OT 

IF  ( ( VAL . GE . BEST )  .OR.  (VAL.EQ.0))  GOTO  2000 

BEST-VAL 

BWAIT-WAIT 

BOT-OT 

DO  241  MM=1 , NAPT 

X  (N+l ,  MM)  —X  (A,  MM) 

CONTINUE 

CONTINUE 

IF  (BEST . GE . OLDBEST)  PRINT*,  'hallelula' 

IF  (BEST. GE. OLDBEST)  GOTO  131 
DO  30  GG-1,  N 

X  (GG,  1 . )  —X  (N+l . ,  1 . ) 

DO  40  HH-2, NAPT-1 

X (GG, HH) —X (N+l . , HH) 

CONTINUE 

X (GG, NAPT) =X (N+l . , NAPT) 

CONTINUE 

DO  1747  PP-1 , N-l . 

DO  888  JJ=1 , N-l . 

IF  (X (PP , PP*STAGES+JJ*STAGES)  .EQ.  0.)  GOTO  888 
IF  (  X(PP,  PP*STAGES+JJ* STAGES)  .EQ.  1)  ARF-3+ARF 
IF  ( (PP*STAGES+JJ*STAGES)  .EQ.  NAPT)  ARF-3+ARF 
IF  (ARF  .EQ.  6)  GOTO  2468 

X (PP,  PP*STAGES+JJ* STAGES) -X (PP, PP*STAGES+JJ*STAGES) -1 . 
X (PP , PP*STAGES) =X (PP , PP* STAGES) +1 . 

GOTO  1746 
CONTINUE 
ARF—0 
CONTINUE 

PRINT*,  'dabestis',  BEST 
WRITE (2,*)  'dabeast',  BEST 
OLDBEST-BEST 
GOTO  130 

PRINT* ,  '  youreatheend' 

PRINT*,  ' verybestis' ,  BEST 
PRINT*,  (X (N+l, TT) ,TT=1, NAPT) 


131 


789 


WRITE (2,  *)  (X<N+1,RR)  ,RR-1,NAPT) 

WRITE (2,*)  BEST,  ' -  theverybest ' ,  'WAIT-',  BWAIT,  '0T-' 
FORMAT (F5.1) 

STOP 

END 


,  BOT 


D-l 

DO  14  M-L,  K 

TEMP-P(K,  D)  *Q  (K-1,M) 

SUM2-SUM2+TEMP 

D-D+l 

14  CONTINUE 

Q(K,L+1)-SUM2 
SUM1-SUM1+SUM2 
12  CONTINUE 

Q(K,  D-1.-SUM1 
10  CONTINUE 

DO  7  R— 1 , NAPT 
W  (R)  -0 . 

7  CONTINUE 

DO  33  E-1,NAPT 
STORE-O . 

DO  44  F»2,E+1 

STORE-Q (E,  F) * (F-l ) /U 
W(E)-W(E)+STORE 
44  CONTINUE 

33  CONTINUE 

WAIT-0 . 

OT-O. 

CHECK-1 . 

DO  55  G— 1, NAPT-1 

DO  555  GG— 1 . , NAPT 

IF  ( (CHECK/ STAGES ) .EQ.  GG)  WAIT-W (G) +WAIT 
555  CONTINUE 

CHECK— CHECK+ 1 . 

55  CONTINUE 

OT=W (NAPT) *C 
VAL— WAIT+OT 

IF  ( (VAL. GE. BEST)  .OR.  (VAL.EQ.O))  GOTO  2000 

BEST-VAL 

BWAIT-WAIT 

BOT-OT 

DO  241  MM—1 , NAPT 

X (N+l , MM) —X (A, MM) 

241  CONTINUE 

2000  CONTINUE 

*  IF  (BEST . GE . OLDBEST)  PRINT*,  'hallelula' 

IF  (BEST. GE. OLDBEST)  GOTO  131 

*  INITIALIZE  ALL  SCHEDULES  TO  CURRENT  BEST 
DO  30  GG— 1,  N 

X  (GG,  1 . ) —X (N+l . , 1 . ) 

DO  40  HH-2, NAPT-1 

X  (GG,  HH)  —X  (N+l . ,  HH) 

CONTINUE 

X (GG,  NAPT) -X (N+l . , NAPT) 

CONTINUE 
DO  747  PP—1 , N-l . 

THE  APPOINMEMNT 

IF  (X (N+l . , STAGES*PP)  .EQ.  0.)  GOTO  747 
X (PP , PP * STAGES ) =X(PP , PP* STAGES) -1 . 

X (PP, PP*STAGES+STAGES) -X (PP, PP*STAGES+STAGES) +1 . 

CONTINUE 

PRINT*,  ' bestis' ,  BEST 
WRITE (2,*)  'best',  BEST 
OLDBEST-BEST 
GOTO  130 

PRINT*,  ' youreatheend' 

PRINT*,  ' verybestis' ,  BEST 
PRINT*,  (X (N+l, TT) ,TT=1, NAPT) 

WRITE (2,*)  (X (N+l, RR) ,RR=1, NAPT) 

WRITE (2 , *)  BEST,  '=  theverybest' ,  'WAIT-',  BWAIT,  'OT=',  BOT 
FORMAT (F5.1) 


40 

30 

*  MOVE 

747 

* 

* 
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*  THIS  PROGRAM  FINDS  THE  LATEST  CANDIDATE  SCHEDULE  FOR  r-ERLANG 

*  DISTRIBUTIONS  -  SERVER  COST  MEASURED  AS  OVERTIME 

REAL*8  X  (200,  200)  ,Y <200, 200)  ,P  (200,200)  ,Q  (200,  200)  ,W<200) 
REAL* 8  U, SUM, SUM1 , SUM2 

REAL *8  WAIT, STORE, C, OT, TEMP, FACT, BEST, VAL, OLDBEST, TOTAL,  N 
REAL* 8  NAPT,NSLT, CHECK, CUSMU, STAGES, BWAIT, BOT 
INTEGER  I,  A,  J,D,L,K,M,  Z 
OPEN  (UNIT-2,  FILE-' algo. out' ) 

BEST-10000000. 

OLDBEST-10000000 . 

*  INPUT  PARAMETERS 

N-25. 

NSLT-32 . 

C-0. 

STAGES— 2 . 

CUSMU-  1. 

WRITE (2,*)  STAGES,  '-Erlang'  ,'  U-' ,  CUSMU,  N,  '  CUSTOMERS' 

WRITE (2,  *)  'Cost  Factor  -  ',  C, ' server  cost  is  overtime' 

WRITE (2,*)  '#  of  Slots  -  ',  NSLT 

U-CUSMU* STAGES 

TOTAL-N+1 

NAPT-N*STAGES 

DO  1  F— 1 , NAPT+1 . 

DO  2  G—l , F 
P  (F,  G) —0 . 

Q  (F,  G) =0 . 

2  CONTINUE 

I  CONTINUE 

*  INITIALIZE  THE  FIRST  SCHEDULE 

DO  3  G—l ,  TOTAL 

DO  434  CC-1,  STAGES- 1 . 

X (G, CC) —0 . 

434  CONTINUE 

X (G, STAGES) -NSLT-1 . 

DO  4  H— STAGES+1 . , NAPT-1 . 

X (G,  H) =0 . 

4  CONTINUE 

X (G, NAPT) — 1 . 

3  CONTINUE 

130  DO  2000  A=1 , N-l . 

DO  11  B— 1, NAPT 

Y  (A,  B)  -X  (A,  B)  *U 

II  CONTINUE 
Z— 0 

*  calculate  the  P  probabilities  for  each  schedule 

DO  201  1=1, NAPT 

Z-Z+l 

SUM-0. 

FACT-1 . 

* 

DO  101  J=1,I 

P (I, J) -EXP (-Y (A, Z) ) * ( (Y (A, Z) ** ( J-l) ) /FACT) 

SUM-SUM+P (I, J) 

FACT-FACT* ( J) 

101  CONTINUE 

P (I, I+l)=l .-SUM 
201  CONTINUE 

★ 

*  calculate  the  Q  probabilities-P  (i  services) 

Q  ( 1 » 2 )  — P  ( 1 , 1 ) 

Q (1 , 1 ) =1-Q (1,2) 

DO  10  K— 2 , NAPT 
SUM1-0. 

DO  12  L— 1 , K 
SUM2-0 . 

TEMP-0 . 


STOP 

END 


*  THIS  CODE  FINDS  EARLIEST  CANDIDATE  SCHEDULE -  SERVICE  -  r-ERLANG 

*  SERVER  COST  MEASURED  AS  TIME  UNTIL  SERVER  SHUTS  DOWN 

R£AL*8  X (200, 200) ,Y (200, 200) ,P (200, 200) ,Q (200, 200) ,W(200) 
REAL* 8  U, SUM, SUM1 , SUM2 ,  GG 

REAL* 8  WAIT, STORE, C, OT, TEMP, FACT, BEST, VAL, OLDBEST, TOTAL, N 
REAL* 8  NAPT, NSLT, CHECK, CUSMU, STAGES, BWAIT, BOT 
INTEGER  I, A, J, D, L, K, M, Z, ARF , PLACE 
OPEN  (UNIT-2,  FILE-' parml .out' ) 

BEST-10000000. 

OLDBEST-1000G00 . 

PLACE-0 
ARF— 0 
N-16 . 

NSLT— 20 . 

C-5 . 

STAGES— 2 . 

CUSMU-  1. 

WRITE (2,*)  STAGES,  '-Erlang'  ,'  U-' ,  CUSMU,  N,  '  CUSTOMERS 

WRITE (2,*)  'Cost  Factor  -  ',  C, ' server  cost  is  overtime' 

WRITE (2,*)  '#  of  slots  -  ',  NSLT 

U-CUSMU* STAGES 

TOTAL— N+l 

NAPT-N* STAGES 

DO  1  F—l , NAPT+1 . 

DO  2  G— 1 , F 
P  (F,  G) =0 . 

Q (F,  G) —0 . 

2  CONTINUE 

I  CONTINUE 

DO  3  G— 1,  TOTAL 

DO  434  CC-1,  NAPT-1 . 

X (G, CC) —0 . 

434  CONTINUE 

X  (G,  NAPT)  =NSLT 

3  CONTINUE 

130  DO  2000  A— 1 , N-l . 

DO  11  B=1 , NAPT 

Y  (A,  B)  =X  (A,  B)  *U 

II  CONTINUE 

*  PRINT*,  'i  initialized  everything' 

Z— 0 

*  next  calculate  the  P  probabilities 

DO  201  1=1, NAPT 

Z=Z+1 

SUM=0. 

FACT-1 . 

* 

DO  101  J-1,I 

P  (I,  J)  =EXP  (-Y  (A,  Z)  )  *  (  (Y  (A,  Z)  **  (J-l)  )  /FACT) 

SUM=SUM+P  (I,  J) 

FACT-FACT* (J) 

101  CONTINUE 

P  (I, I  +  l)=l .-SUM 

201  CONTINUE 

★ 

*  calculate  the  Q  probabilities 

Q  ( 1 , 2 )  — P  ( 1 , 1 ) 

Q (1 , 1 ) =1-Q (1,2) 

DO  10  K=2 , NAPT 
SUM1-0. 

DO  12  L=1 , K 
SUM2-0 . 

TEMP-0 . 

D=1 

DO  14  M-L,  K 

TEMP-P (K, D) *Q (K-l ,  M) 


14 


12 

10 


7 


44 

33 


555 

55 


929 

930 


241 

2000 


40 

30 


2468 

888 

1746 

1747 


SUM2-SUM2+TEMP 
D-D+l 
CONTINUE 
Q(K,L+1)-SUM2 
SUM1-SUM1+SUM2 
CONTINUE 
Q(K,  1)-1.-SUM1 
CONTINUE 
DO  7  R-1,NAPT 
W  (R)  -0. 

CONTINUE 
DO  33  E-l, NAPT 
STORE-O . 

DO  44  F-2,E+1 

STORE-Q(E,F) * (F-l) /U 
W(E)-W(E)+STORE 
CONTINUE 
CONTINUE 
WAIT-0 . 

OT-0. 

CHECK-1 . 

DO  55  G=1 , NAPT-1 

DO  555  GG—1 . , NAPT 

IF  ( (CHECK/STAGES) .EQ.  GG)  WAIT— W (G) +WAIT 
CONTINUE 
CHECK— CHECK+ 1 . 

CONTINUE 

IF  (X(A,NAPT) .EQ.  0.)  PLACE-NSLT 
DO  929  SS-1,  NSLT 

IF  (X (A, NAPT) . EQ.SS)  PLACE-  NSLT-X (A, NAPT) +1 . 

CONTINUE 

OT- (W (NAPT-1 . ) +PLACE+1 . /U) *C 
VAL— WAIT+OT 

IF  ( (VAL. GE. BEST)  .OR.  (VAL.EQ.0))  GOTO  2000 

BP LACE-PLACE 

BEST-VAL 

BWAIT— WAIT 

BOT-OT 

DO  241  MM-1 , NAPT 

X (N+l , MM) —X (A, MM) 

CONTINUE 

CONTINUE 

IF  (BEST . GE . OLD BEST )  PRINT* ,  'hallelula' 

IF  (BEST.GE . OLDBEST)  GOTO  131 
DO  30  GG—1 ,  N 

X (GG, 1 . ) —X (N+l . ,  1 . ) 

DO  40  HH-2, NAPT-1 

X  (GG,  HH)  -X  (N+l . ,  HH) 

CONTINUE 

X (GG, NAPT) -X (N+l . , NAPT) 

CONTINUE 

DO  1747  PP— 1 , N-l . 

DO  888  JJ— 1 , N-l . 

IF  (X (PP , PP*STAGES+JJ* STAGES)  .EQ.  0.)  GOTO  888 
IF  (  X(PP,  PP*STAGES+JJ* STAGES)  .EQ.  1)  ARF-3+ARF 
IF  ( (PP*STAGES+JJ* STAGES)  .EQ.  NAPT)  ARF-3+ARF 
IF  (ARF  .EQ.  6)  GOTO  2468 

X (PP, PP*STAGES+JJ*STAGES)=X (PP, PP*STAGES+JJ* STAGES) -1 . 
X (PP , PP* STAGES) -X (PP, PP* STAGES) +1 . 

GOTO  1746 
CONTINUE 
ARF-0 
CONTINUE 


PRINT*,  'bestis',  BEST 
WRITE (2,*)  'beast',  BEST 
OLDBEST-BEST 
GOTO  130 

131  PRINT*,  ' youreatheend' 

PRINT*,  ' verybeatis' ,  BEST 
PRINT*,  (X (N+l , TT) , TT— 1 , NAPT) 

WRITE (2, *)  (X (N+l,  RR) ,RR-1, NAPT) 

WRITE (2, *)  BEST,  ' -  theverybest' ,  'WAIT-',  BWAIT,  'OT-',  BOT 
789  FORMAT (F5.1) 

STOP 

END 


*  THIS  CODE  FINDS  LATEST  CANDIDATE  SCHEDULE -  SERVICE  -  r-ERLANG 

*  SERVER  COST  MEASURED  AS  TIME  UNTIL  SERVER  SHUTS  DOWN 

REAL*8  X  (200, 200) ,Y (200, 200) ,P (200, 200) ,Q (200, 200) ,W(200) 

REAL* 8  U, SUM, SUM1 , SUM2 , PLACE, CUSMU, STAGES, GG 

REAL*  8  WAIT , STORE , C , OT , TEMP , FACT , BEST , VAL, OLDBEST , TOTAL, N 

REAL*8  NAPT, NSLT, BWAIT, BOT, SS, BP LACE 

INTEGER  I,  A,  J,D,L,K,M,  Z 

OPEN  (UNIT-2,  FILE-' 3exp2532srv. out' ) 

BEST-100000000. 

OLD BEST-1 00000000 . 

PLACE-0 . 

N-5 . 

NSLT— 7 . 

STAGES- 1 . 

CUSMU— 1 . 

U-CUSMU* STAGES 
C-4. 

WRITE (2,*)  STAGES,  '-Erlang'  ,'  U-' ,  CUSMU,  N,  '  CUSTOMERS' 
WRITE (2,*)  'Cost  Factor  -  ',  C, ' server  cost  ' 

WRITE (2,*)  '#  Of  slots  -  ',  NSLT 

*  HERE's  where  i'd  go  back 

TOTAL— N+l 

NAPT-N* STAGES 

DO  1  F=1,N*STAGES+1. 

DO  2  G=1 , F 
P  (F,  G) —0 . 

Q(F,G)=0. 

2  CONTINUE 

I  CONTINUE 

DO  3  G-l ,  TOTAL 

DO  434  CC-1,  STAGES-1 . 

X  (G,  CC)  —0  . 

434  CONTINUE 

X (G, STAGES) -NSLT- 1 . 

DO  4  H— STAGES+1 . , NAPT-1 . 

X (G, H) —0 . 

*  PRINT*,  ' X (G, H) ' ,  X (G, H) 

4  CONTINUE 

X (G, NAPT) —1 . 

*  PRINT*, 'X(G, NAPT)-'  ,  X(G,NAPT) 

3  CONTINUE 

130  DO  2000  A— 1 , N-l 

DO  11  B— 1, NAPT 

Y  (A,  B)  —X  (A,  B)  *U 

II  CONTINUE 

*  PRINT*,  'i  initialized  everything' 

Z— 0 

*  PRINT*,  'calculate  p' 

*  next  calculate  the  P  probabilities 

DO  201  1=1, NAPT 

Z-Z+l 

SUM-0. 

FACT-1 . 

* 

DO  101  J=1,I 

P  (I,  J)  -EXP  (-Y  (A,  Z)  )  *  (  (Y  (A,  Z)  **  ( J-l)  )  /FACT) 

SUM— SUM+P ( I , J) 

FACT-FACT* ( J) 


101 

CONTINUE 

P (1, 1  +  1) — 1 .-SUM 

201 

A 

CONTINUE 

* 

PRINT*,  '  i  got  to  q' 

★ 

calculate  the  Q  probabilities 

Q(1,2)=P(1,1) 

Q (1, 1) — 1-Q (1,2) 


44 

33 


555 

55 

* 

★ 

* 

★ 


929 
* 

930 
* 

* 

* 

* 


241 

* 

★ 

* 

* 

★ 

* 

* 

* 


DO  10  K-2 , NAPT 
SUM1-0 . 

DO  12  L-1,K 
SUM2-0 . 

TEMP-0 . 

D— 1 

DO  14  M-L,  K 

TEMP— P (K, D) *Q(K-1,M) 
SUM2 -SUM2  +TEMP 


D-D+l 

14 

CONTINUE 

Q (K, L+l ) — SUM2 

SUM1-SUM1+SUM2 

12 

CONTINUE 

Q(K,  D-1.-SUM1 

10 

CONTINUE 

DO  7  R— 1 , NAPT 
W  (R)  -0. 

CONTINUE 
DO  33  E— 1 , NAPT 
STORE— 0 . 

DO  44  F— 2, E+l 

STORE-Q (E,  F) * (F-l) /U 
W (E) — W (E) + STORE 
CONTINUE 
CONTINUE 
WAIT-0 . 

OT-O . 

CHECK-1 . 

DO  55  G— 1, NAPT-1 
DO  555  GG-1 , NAPT 

IF  ( (CHECK/STAGES) .EQ.  GG)  WAIT— W (G) +WAIT 
CONTINUE 
CHECK— CHECK+ 1 . 

CONTINUE 

PRINT*, 'OVERTIME  IS',W(N) 

WRITE (2,*)  'OVERTIME  IS',  W(NAPT) 

IF  (X(A,NAPT) .EQ.  0.)  PLACE— NSLT 
IF  (X  (A,  NAPT)  .EQ.  0.)  GOTO  930 
DO  929  SS-1,  NSLT 

IF  (X (A, NAPT) .EQ.SS)  PLACE-  NSLT-X (A, NAPT) +1 
CONTINUE 

PRINT*,  'PLACE-  ',  PLACE 
OT- (W (NAPT-1 . ) +PLACE+1 . /U) *C 
PRINT* ,' WAITING  TIME  IS',  WAIT,  NAPT, PLACE, U 
PRINT*,  'OT  COST  IS',  OT,A 
VAL-WAIT+OT 

PRINT*,  ' thebestisfirsttime' ,  VAL 
PRINT*,  'thebestis',  VAL 
IF  ( (VAL. GE. BEST) .OR.  (VAL.EQ.0))  GOTO  2000 
BP LACE— PLACE 
BEST-VAL 
BWAIT— WAIT 
BOT-OT 

PRINT*,  'thebestis',  VAL 
DO  241  MM-1 , NAPT 

X (N+l , MM) —X (A, MM) 

CONTINUE 

PRINT*,  ' iswitched' 

IF  (VAL. LT. BEST)  NUM-A 
IF  ( VAL. LT. BEST)  BEST-VAL 
WRITE (2,*)  'WAITING  TIME  IS',  WAIT 
WRITE (2,*)  'OVERTIME  COST  IS',  OT 
WRITE (2,*)  'TOTAL  COST  FOR  SCHEDULE' 

PRINT*,  'TOTAL  COST  FOR  SCHEDULE' 

WRITE (2,*)  '  ' 


,  A, 
A,  ' 


,  WAIT+OT 
WAIT+OT 


* 

* 

2000 

* 


* 


* 


40 

* 

30 

* 


* 


747 

*129 


131 


789 


WRITE (2,*)  NUM,  BEST 
PRINT*,  ' iendedupat2000' 

CONTINUE 

IF  (BEST . GE . OLDBEST)  PRINT*,  'hallelula' 

IF  ( BEST. GE. OLDBEST)  GOTO  131 
PRINT*,  'almost  made  it' 

PRINT*,  'II',  X (9, 1) , X (9, 2 ) , X (9, 3) , X (9, 4 ) ,X(9, 5) 

PRINT*,  X(9,6),X(9,7),X(9,8) 

DO  30  GG-1,  N 

X (GG, 1)«X(N+1.,1.) 

PRINT*,  ' X (GG, 1 . )  — ' ,  X (GG, 1 . ) 

DO  40  HH-2 , NAPT-1 

X (GG, HH) -X (N+l . , HH) 

PRINT*,  ' X (GG, HH)  -' ,  X (GG, HH) 

CONTINUE 

X (GG, NAPT) -X (N+l . , NAPT) 

PRINT*,  ' X (GG, NAPT) -' ,  X (GG, NAPT) 

CONTINUE 

PRINT*,  'i  gotta  best  solution' 

WRITE  (2,*)  X(9,l)  , X  ( 9,  2 )  , X  ( 9,  3)  , X  ( 9,  4 )  ,X(9,5) 

WRITE  (2,  *)  X(9,  6)  ,X(9,  7)  ,X(9,  8) 

PRINT*,  X(9,1),X(9,2),X(9,3),X(9,4),X(9,5),X(9,6),X(9,7),X(9,8) 
DO  747  PP=1 , N-l . 

IF  (X (N+l, STAGES*PP)  .EQ.  0.)  GOTO  747 
X (PP , PP* STAGES ) -X (PP, PP* STAGES) -1 . 

X (PP, PP*STAGES+STAGES) =X (PP, PP*STAGES+STAGES) +1 . 

PRINT*,  X (PP,PP* STAGES ) ,  X (PP,PP*STAGES+STAGES) ,PP 
CONTINUE 

PRINT* ,'  OLDBEST**'  ,  OLDBEST,  'BEST-',  BEST 
PRINT*,  (X (N+l, LL) ,LL-1, NAPT) 

WRITE (2,*)  'dabest:  ',  BEST,  'place-  ',  BP LACE 
PRINT*,  'dabest:',  BEST,  'place-  ',  BP LACE 
PRINT*,  'X (A, NAPT)',  X (A,  NAPT) 

WRITE (2,*)  (X (N+l, BB) ,BB=1, NAPT) 

OLDBEST-BEST 
BWAIT-WAIT 
BOT-OT 
GOTO  130 

PRINT*,  ' youreatheend' 

PRINT*,  'daverybestis' ,  BEST 
WRITE (2,*)  (X (N+l, RR) ,RR-1, NAPT) 

WRITE (2, *)  BEST,  ' theverybest ' ,  'WAIT-',  BWAIT,  'OT=',  BOT 
PRINT*,  (X (N+l, TT) ,TT=1, NAPT) 

FORMAT (F5.1) 

STOP 

END 


***  THIS  PROGRAM  APPROXIMATES  THE  EARLIEST  CANDIDATE 
***  SCHEDULE  FOR  THE  CONTINUOS  CASE 

REAL* 8  X (200, 200) ,  Y (200, 200) #P (200, 200) 

REAL*8  Q(200,200) ,W(200) 

REAL*  8  U , SUM, SUM1 , SUM2 ,  GG 

REAL* 8  WAIT, STORE, C, OT, TEMP , FACT, BEST, VAL, OLDBEST,  TOTAL, N 
REAL* 8  NAPT,  NSLT,  CHECK,  CUSMU,  STAGES,  TRIAL,  BWAIT,  BOT 
INTEGER  I, A, J,D,L,K,M, Z, COUNT 
OPEN  (UNIT-2,  FILE-' realcont. out') 

BEST-100000. 

OLDBEST-100000 . 

COUNT- 1 
TRIAL-1 . 

N-5 . 

NSLT-7 . 

C— 4 . 

STAGES— 1 . 

CUSMU— 1 . 

WRITE (2,*)  STAGES,  '-Erlang'  ,'  U-' ,  CUSMU,  N,  '  CUSTOMERS 
WRITE (2,*)  'Cost  Factor  -  ',  C, ' server  cost  is  overtime' 

WRITE (2,*)  '#  of  slots  -  ',  NSLT 

WRITE (2,*)  '  ' 

WRITE (2, *)  ' *********************************************** 
WRITE (2,*)  '  ' 

GOTO  787 

767  NSLT— NSLT* 2 . 

TRIAL-TRIAL* 2 . 

COUNT—COUNT+ 1 
CUSMU— CUSMU/2 . 

BEST-100000 . * TRIAL 
OLDBEST— 100000 . * TRIAL 
787  U-CUSMU* STAGES 

TOTAL— N+l 
NAPT-N* STAGES 
DO  1  F— 1 , NAPT+1 . 

DO  2  G— 1, F 
P  (F ,  G)  =0  . 

Q(F,G)=0. 

2  CONTINUE 

I  CONTINUE 

IF (TRIAL. GT.l.)  GOTO  420 
DO  3  G— 1,  TOTAL 

DO  434  CC-1,  STAGES-1. 

X (G, CC) —0 . 

434  CONTINUE 

X (G, STAGES) — NSLT-1 . 

DO  4  H— STAGES+1 . , NAPT-1 . 

X (G, H) =0 . 

4  CONTINUE 

X (G, NAPT) — 1 . 

3  CONTINUE 
GOTO  130 

420  DO  421  DD-1, TOTAL 

X  (DD, 1 . ) —X (DD, 1 . ) *2 . +2 . 

DO  422  EE-2, N-l. 

X  (DD, EE) =2 . *X (DD, EE) 

422  CONTINUE 

IF  (X (DD, N) . EQ. 1 )  X (DD, N) —X (DD, N) *2 . 

IF  (X(DD,N) .GT.l)  X(DD,N)=X(DD,N) *2.-2. 

421  CONTINUE 

130  DO  2000  A— 1 , N-l . 

DO  11  B-l, NAPT 

Y  (A,  B)  —X  (A,  B)  *U 

II  CONTINUE 

*  PRINT*,  'i  initialized  everything' 

Z-0 


*  next  calculate  the  P  probabilities 
DO  201  I-1,NAPT 

Z-Z+l 

SUM-0. 

FACT-1 . 

* 

DO  101  J-1,I 

P (I,  J) -EXP  <-Y (A, Z) ) * ( (Y (A, Z) ** ( J-l) ) /FACT) 
SUM-SUM+P (I, J) 

FACT-FACT* ( J) 

101  CONTINUE 

P(I,I+1)— 1. -SUM 
201  CONTINUE 

* 

*  calculate  the  Q  probabilities 

Q(l/2)-P(l,l) 

Q(l,l)=l-Q(l,2) 

DO  10  K=2 , NAPT 
SUM1-0 . 

DO  12  L— 1 , K 
SUM2-0 . 

TEMP-0 . 

D=1 

DO  14  M=L,  K 

TEMP=P (K, D) *Q (K-1,M) 

SUM2—SUM2  +TEMP 
D=D+1 

14  CONTINUE 

Q (K, L+l ) =SUM2 
SUM1=SUM1+SUM2 
12  CONTINUE 

Q (K, 1 ) =1 . -SUM1 
10  CONTINUE 

DO  7  R=1 , NAPT 
W  (R)  —0 . 

7  CONTINUE 

DO  33  E— 1 , NAPT 
STORE-O . 

DO  44  F=2, E+l 

STORE-Q (E,  F)  * (F-l ) /U 
W  (E)  =  (W (E) +STORE) 

44  CONTINUE 

33  CONTINUE 

WAIT-0 . 

OT=0 . 

CHECK- 1 . 

DO  55  G=1 , NAPT-1 

DO  555  GG=1 . , NAPT 

IF  ( (CHECK/STAGES) .EQ.  GG)  WAIT-W (G) +WAIT 
555  CONTINUE 

CHECK—CHECK+1 . 

55  CONTINUE 

OT=W (NAPT) *C 
VAL—WAI T+OT 

IF  ( (VAL.GE . BEST)  .OR.  (VAL.EQ.0))  GOTO  2000 

BEST-VAL 

BWAIT—WAIT 

BOT-OT 

DO  241  MM=1 , NAPT 

X (N+l , MM) — X (A, MM) 

241  CONTINUE 

2000  CONTINUE 

IF  (BEST . GE . OLDBEST)  GOTO  131 
DO  30  GG=1 ,  N 

X (GG, 1 . ) =X (N+l . ,  1 . ) 

DO  40  HH= 2, NAPT-1 


X(GG,HH)-X(N+1.,HH) 

40  CONTINUE 

X (GG, NAPT) -X (N+l . , NAPT) 

30  CONTINUE 

* 

DO  747  PP«1,N-1. 

IF  (X (N+l . , STAGES*PP)  .EQ.  0.)  GOTO  747 
X  (PP,  PP* STAGES)  =*X  (PP, PP*STAGES)  -1 . 

X (PP, PP*STAGES+STAGES) -X (PP, PP*STAGES+STAGES) +1 . 

747  CONTINUE 

PRINT*,  'bestis',  BEST/TRIAL 

OLDBEST-BEST 

GOTO  130 

131  PRINT*,  ' youreatheend' 

PRINT*,  ' verybestis' ,  BEST/TRIAL 
PRINT*,  BWAIT/TRIAL,  BOT/TRIAL 
PRINT*,  (X (N+l, TT) ,TT-1, NAPT) 

PRINT* ,  ' count-  ' ,  COUNT 
WRITE (2,*)  (X (N+l, RR) ,RR=1, NAPT) 

WRITE (2,*)  'verybest-  ',  BEST/TRIAL,'  COUNT-  ',  COUNT 
WRITE (2,*)  'WAIT-' , BWAIT/TRIAL,  'OT-'  , BOT/TRIAL 
WRITE (2,*)  '  ' 

IF (1/NSLT . GT . 0)  GOTO  767 
•*  IF (NSLT.LT. 1000000000)  GOTO  767 

789  FORMAT (F5.1) 

STOP 

END 


***  THIS  PROGRAM  APPROXIMATES  THE  LATEST  CANDIDATE  SCHEDULE 
***  FOR  THE  CONTINUOUS  PROBLEM 

R£AL*8  X (200, 200) ,  Y (200, 200) ,P (200,200) 

REAL*8  Q  (200, 200) , W (200) 

REAL* 8  U, SUM, SUM1 , SUM2 ,  GG,  TP 

REAL* 8  WAIT, STORE, C, OT, TEMP, FACT, BEST, VAL, OLDBEST, TOTAL, N 
REAL* 8  NAPT, NSLT, CHECK, CUSMU, STAGES, TRIAL, BWAIT, BOT 
INTEGER  I, A, J, D, L, K, M, Z, COUNT 
OPEN  (UNIT-2,  FILE-' lrealcont . out' ) 

BEST-100000. 

OLDBEST-1 00000. 

COUNT- 1 
TRIAL-1 . 

N-5 . 

NSLT— 7 . 

C-4. 

STAGES— 1 . 

CUSMU— 1 . 

WRITE (2,*)  STAGES,  '-Erlang'  ,'  U-' ,  CUSMU,  N,  '  CUSTOMERS 
WRITE (2,*)  'Cost  Factor  =  ',  C, ' server  cost  is  overtime' 

WRITE (2,*)  '#  Of  Slots  -  ',  NSLT 

WRITE (2,*)  '  ' 

WRITE (2, *)  ' *********************************************** 
WRITE (2,*)  '  ' 

GOTO  787 

767  NSLT=NSLT*2. 

TRIAL-TRIAL* 2 . 

COUNT— COUNT+ 1 
CUSMU— CUSMU/2 . 

BEST-100000 . * TRIAL 
OLDBEST-1 00000 . * TRIAL 
787  U-CUSMU* STAGES 

TOTAL— N+l 
NAPT-N* STAGES 
DO  1  F— 1 , NAPT+1 . 

DO  2  G— 1 , F 
P (F, G) —0 . 

Q (F, G) —0 . 

2  CONTINUE 

I  CONTINUE 

IF (TRIAL. GT.l.)  GOTO  445 
DO  3  G-l,  TOTAL 

DO  434  CC-1,  NAPT-1 . 

X (G,  CC) -0 . 

434  CONTINUE 

X(G, NAPT) -NSLT 

3  CONTINUE 
GOTO  130 

445  TP-0. 

TP-TP+1 . 

IF (X (N+l . , TP) .EQ.  0.)  GOTO  445 

420  DO  421  DD-1., TOTAL 

X  (DD,  TP)  —X  (DD,  TP)  *2  .  -  2. 

DO  422  EE— TP+1 . , N-l . 

X (DD, EE) —  X (DD, EE)  *  2. 

422  CONTINUE 

X  (DD,  N)  =2  .  *X  (DD,  N)  +2  . 

421  CONTINUE 

130  DO  2000  A— 1 , N-l . 

DO  11  B— 1 , NAPT 

Y  <A,B)=X  (A,  B)  *U 

II  CONTINUE 
Z-0 

*  next  calculate  the  P  probabilities 

DO  201  1=1, NAPT 
Z-Z+l 


★ 


SUM-O. 
FACT-1 . 


DO  101  J-1,I 

P (I, J) -EXP (-Y (A, Z) ) * ( (Y (A, Z)  ** ( J-l) ) /FACT) 
SUM-SUM+P  (I,  J) 

FACT-FACT* ( J) 

101  CONTINUE 

P{I,I+1)=1. -SUM 
201  CONTINUE 

★ 

*  calculate  the  Q  probabilities 

Q(1,2)»P(1,1) 

Q (1, 1) -1-Q (1, 2) 

DO  10  K— 2 , NAPT 
SUM1-0. 

DO  12  L-l , K 
SUM2-0 . 

TEMP-0 . 

D— 1 

DO  14  M-L,  K 

TEMP— P (K, D) *Q(K-1,M) 

SUM2-SUM2+TEMP 

D-D+l 

14  CONTINUE 

Q  (K,  L+l )  — SUM2 
SUM1-SUM1+SUM2 
12  CONTINUE 

Q (K, 1) =1 . -SUM1 
10  CONTINUE 

DO  7  R=1 , NAPT 
W (R) =0 . 

7  CONTINUE 

DO  33  E=1 , NAPT 
STORE— 0 . 

DO  44  F=2 , E+l 

STORE-Q (E,  F) * (F-l) /U 
W (E) = (W (E) +STORE) 

44  CONTINUE 

33  CONTINUE 

WAIT-0. 

OT-0. 

CHECK-1 . 

DO  55  G=1 , NAPT-1 

DO  555  GG— 1 . , NAPT 

IF  ( (CHECK/ STAGES ) .EQ.  GG)  WAIT-W (G) +WAIT 
555  CONTINUE 

CHECK— CHECK+ 1 . 

55  CONTINUE 

OT— W (NAPT) *C 
VAL-WAIT+OT 

IF  ( (VAL.GE .BEST)  .OR.  (VAL.EQ.0))  GOTO  2000 

BEST-VAL 

BWAIT— WAIT 

BOT-OT 

DO  241  MM-1 , NAPT 

X (N+1,MM) —X (A, MM) 

241  CONTINUE 

2000  CONTINUE 

*  IF  (BEST . GE . OLDBEST)  PRINT*,  'hallelula' 

IF  ( BEST. GE. OLDBEST)  GOTO  131 
DO  30  GG-1 ,  N 

X (GG, 1 . ) —X (N+l . ,  1 . ) 


DO  40  HH-2, NAPT-1 


X (GG, HH) *=X (N+l . , HH) 

40  CONTINUE 

X (GG, NAPT) -X (N+l . , NAPT) 

30  CONTINUE 

* 

DO  1747  PP=1 , N-l . 

DO  888  JJ=1 , N-l . 

IF  (X(PP,PP*STAGES+JJ* STAGES)  .EQ.  0.)  GOTO  888 
X (PP, PP*STAGES+ JJ*STAGES) =X (PP, PP*STAGES+ JJ*STAGES) -1 . 
X (PP, PP*STAGES) -X (PP, PP*STAGES) +1 . 

GOTO  1747 

888  CONTINUE 

1747  CONTINUE 

PRINT* ,  'bestis',  BEST/TRIAL 

*  WRITE (2,*)  'best' , BEST/TRIAL 

OLDBEST-BEST 

GOTO  130 

131  PRINT*,  ' youreatheend' 

PRINT*,  ' verybestis' ,  BEST/TRIAL 
PRINT*,  BWAIT/TRIAL,  BOT/TRIAL 
PRINT*,  (X (N+l, TT) ,TT=1, NAPT) 

PRINT*,  '  count**  ',  COUNT 
WRITE (2,*)  (X (N+l, RR) ,RR=1, NAPT) 

WRITE (2,*)  ' verybest=  ',  BEST/TRIAL,'  COUNT=  ',  COUNT 
WRITE (2, *)  ' WAIT=' , BWAIT/TRIAL, 'OT=' , BOT/TRIAL 
WRITE (2,*)  '  ' 

IF (1/NSLT.GT. 0)  GOTO  767 

*  IF (NSLT . LT . 100 )  GOTO  767 

789  FORMAT (F5.1) 

STOP 

END 
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